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Abstract. In this paper we will take a measure-theoretic approach to address 
the problem of eventual returns in a random walk of several dimensions. Wc 
begin by presenting the relevant definitions along with a couple elementary 
but powerful results known as the Borel-Cantelli Lemmas. Next, we will show 
a basic application of the Borel-Cantelli Lemmas to solve the infinite monkey 
problem. Lastly, as promised, we will deliver the main result regarding random 
walks and eventual returns. 



An eventual return of a random walk (to be defined rigorously later) is the event 
that at some later time we get back to where we started. In this paper we will 
answer the question, "What is the probability that wc will eventually return to our 
origin infinitely many times?" One approach to solve this problem is of course to 
explicitly find the probability that we will have an eventual return (not necessarily 
infinitely many times) . This often involves a generous dose of generating functions 
or, even more frequently, an integral of the form (see [2]): 



Using the above integral, one can in fact find the exact probabihty of return in 
a rf-dimensional unbiased random walk. From this number, the probability of an 
infinite number of returns immediately follows. In favor of simplicity, however, 
this paper we will instead take a measure-theoretic approach to solve this problem. 
Although our methods are not robust enough to produce these exact probabilities 
as described above, it is nonetheless instructive and will provide some important 
insight into the (hopefully) surprising results that follow. 



Before delving into our main discussion, wc must first develop the machinery 
that will enable us to make any useful claims about eventual returns. Recall that 
a probability space is defined as a measure space (f2,^, P) such that P(0) = 1. In 
this sense, 17 can be identified with the sample space of our experiment, with the 
family of events, and P as a measure on (f2, J-"). The intuitive meaning of the above 
definition is that if we have an event F G J^, the value < P{F) < 1 represents 
the probability that a point in Cl chosen "at random" belongs to F. 

Now, as hinted at in the Introduction, we are interested in the probability of a 
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specific set of events occurring infinitely many times. The following definition taken 
from [4] makes this statement rigorous. 

Definition 2.1. Suppose that {En € .F : n e N} is a sequence of events. We 
define: 

{En, i.o.) ;=; (En infinitely often) 

m n>m 

= {u) : for every m, 3n(a;) > m such that u) G En^^)} 

= {u : u G En for infinitely many n}. 

We now have all of the necessary definitions to present the main results of this 
section. We begin with the first Borel-Cantelli Lemma. 

Lemma 2.2 (Borel-Cantelli). Let {En G : n gN} be a sequence of events such 
thatY,P{En) < oo. Then P(i;„, i.o.) = 0. 

Proof. Using Definition 2.1, we have 

P(i?„, i.o.) = Pjf||j£;„j<pj y En 

\ m n>m / y n>mo 

n>mo 

for all mo G N. Since J2n>mo P(-^n) i as mo t the result follows. <^ 

The natural question that now arises is whether or not the converse of Lemma 
2.2 holds, i.e. does P(-B„, i.o.) = X^P(-Bn) < oo? It turns out that such 

a converse does exist as long we strengthen our hypotheses slightly. This partial 
converse is commonly known as the second Borel-Cantelli Lemma. 

Lemma 2.3 (Borel-Cantelli). Let {En G !F : n gN} be a sequence of independent 
events such that X^P(-B„) = oo. Then P{En, i.o.) = 1. 

Proof. Wc proceed as wc did in the proof of the first Borel-Cantelli Lemma by 
simply arguing from Definition 2.1. For all mo € N we have 

P{En, i.O.) = 1-P {{En, i.O.)^) = 1 - P I U fl ^" 

\ m n>m 

> 1-P I n eA =1- n {i-p{En)) 

\n>mo I n>mo 

where the last equality follows from our independence hypothesis. Now, note that 
elementary inequality 1 — a; < which may be proved by a simple derivative 
argument (or better yet, a picture). Using this inequality we have 

P{En,\.o) > 1- [] e-P(^") = l-e-Sn>^oP(^'') 

n>mo 

= 1 

which is still true for all mo G N. Thus P{En, i.o.) > 1. Lastly, by virtue of being 
a probability measure, it is clear that P(-B„, i.o.) < 1. The results follows. {} 
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Remark 2.4. Notice that in the statement of the second Borel-CantelU Lemma 
above, we included the extra hypothesis of independence of S„. Observe that pair- 
wise independence is not strong enough (why?). Furthermore, there are examples 
that show this is indeed a necessary condition, i.e. there exists a sequence of de- 
pendent (or even just pairwise independent) events En such that the statement of 
Lemma 2.3 does not hold! 

3. Infinite Monkeys 

With the Borcl-CantcUi Lemmas in our arsenal, we finally possess the machinery 
to tackle our original problem. But first, we turn to a silly (but fun) application 
relating to infinite monkeys. The precise statement is that given a monkey typing on 
a typewriter for an infinite amount of time, they will eventually type the collected 
works of Shakespeare infinitely many times (or type the Bible, or construct a proof 
of Fermat's Last Theorem, etc.). To prove this, note that there is a positive 
probability e such that the monkey will immediately type Moby Dick (there are a 
finite number of characters k in the story, and each character in turn has a positive 
probability of being struck). Denote this as the event Ei. Similarly, there is an 
equal probability e that the next k characters typed will be Moby Dick. Denote 
this event as E2. Proceeding, we define Ej to be the event that the j group of 
k characters is Moby Dick. Since each Ej has an equal positive probability of 
occurring, it is clear that the following sum diverges: 



e = 00. 

Since each block of k characters is independent of the other blocks of characters, 
we know that the event Ek are independent and we may apply the Lemma 2.3. We 
see as an immediate consequcncx; of this lemma that the probability of Ej occurring 
for infinitely many j is 1. That is, the monkey will almost surely type Moby Dick 
infinitely many times in an infinite amount of time! 

4. Random Walks and Eventual Returns 

Now we return to the problem of random walks. First, we will rigorously define 
a random walk in d dimensions. 

Definition 4.1. Let Xi be i.i.d. real random variables in M"^. The random walk is 
defined on Xi as the sequence of partial sums 



Sn — 5^ Xi . 



i=l 



The values that Xi takes on define the type of random walk being considered. 
For the purposes of this paper, the random walk in d dimensions will have Xi with 
a uniform probability distribution over 2d possible values as follows: 



d=l 



d=2 : = {0,1}, {0,-1}, {1,0}, {-1,0} 

d=3 : = {0,0,1}, {0,0,-1}, {0,1,0}, {0,-1,0}, {1,0,0}, {-1,0,0} 

The Xi's for higher dimensions follow similarly such that each Xi moves the ran- 
dom walk by one in exactly one of the d dimensions. 
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With the definition of random walks, we can embark on our next captivating jour- 
ney; we seek the answer to the question, "What is the probabiUty of eventual return 
to the origin for a random walk in d dimensions?" However, as mentioned earlier, 
wc arc concerned not with the exact answer to this question but rather the answer 
to the question "What is the probability that we will return to the origin infinitely 
many times?" To answer this, we will first start with the case for d = 1. To relate 
to this mathematical problem, we will think of the random walk in one dimension 
as a "drunken" walk. Imagine a drunkard leaving a bar who is wandering around 
up and down a street; this can be roughly modeled as the random walk as defined 
earlier. 



We would like to calculate P(S'„ = for some n). Note that we can only re- 
turn to the origin if we take an even number of steps. In 2n steps wc must move 
to the right n steps and move to the left n steps. The probability of a particular 
sequence of 2n steps is (i) " and the number of sequences of steps that will return 

to the origin is ( '^^ ) • So, we now have 




We now seek to find the probability of eventual return infinitely many times. Here, 
we will apply the Borel-Cantelli Lemma and calculate ^P(£^„). First, recall Stir- 
ling's formula: 

n! « n"e-"\^^ 
Now, we are ready to proceed with evaluating ^P(i5„). 




, by Stirling's formula 



= oo 



From this result and Lemma 2.3, wc can conclude that P(-E'„, i.o.) = 1, or the 
probability of eventual return infinitely many times in a one dimensional random 
walk is one. 



Now, we will proceed to the case of two dimensions. In our analogy of a drunkard 
leaving a bar, now, our drunken friend is allowed to walk freely in the neighborhood 
i.e. not necessarily limited to walking up and down the street. Let's now examine 
whether the drunkard will safely return back to the bar. 
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Note again that we need an even number (2n) of steps, such that k steps are north, 
k steps are south, (n — k) steps are west, and (n — k) steps are east. Again, the 
probabiUty of a particular path in 2n steps is (j)^"- The total number of different 
paths in 2n steps is So, for two dimensions. 



fe!fc!(n-fe)!(n-fe)!" 

n / -. \ 2n 
P(52„ = 0) = ^ - 
fe=0 ^ 

Summing over all n, we obtain 



(2n) 



k\k\{n - k)\{n - ky: 



OO n / ^ 



n=l fc=0 

oo n 



(2n)! 

4y fc!A;!(n-A;)!(n-fc)! 



(2n)! n!n! 

^47 n\n\ klkUn - ky.(n - ky 
n=i fe=o ^ ' V / V ; 



= si: I 



E 



2n\ /I 



2n n / \ 2 



n I \4 I ^ \ k 

fe=0 ^ 



n=l 



oo ^ 

— , by Stirling's formula 

7rr7. 



, 7rn 

n=l 



OO. 



Again, by Lemma 2.3, we can conclude that P(£'„, i.o.) = 1, or the probability of 
eventual return infinitely many times in a two dimensional random walk is one. So 
our drunkard will certainly return back to the origin. 

Now, take the case where our drunkard had several drinks containing substan- 
tial amounts of the beverage Red Bull, whose motto is "Red Bull gives you wings!" 
With his newfound abihty to fly, this very drunk man also decides to leave the bar 
and walk and fly around in a three dimensional spac;e. So, we will now evaluate 
the probability of eventual return to the origin infinitely many times in a three 
dimensional random walk. 



Using similar arguments as previously, we have 

n h / ^ 

p(^2„ = o) = EE(« 



fc ,,,2„ ^2„)! 



fc=Oj=0 ^ 

Summing over all n, 

oo n k / -1 \ 2n 



j\j\k\k\{n — j — ky.{n — j — ky. 



K n) Z^Z^Z^\qJ j\j\k\k\(n-j-ky{n-j-ky 



n=l fe=0 j=0 

2n 



§ W (^) \3\k\{n-j-ky 
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Now, we can create an upper bound on jik\ii^-j-ky. - ^ = ™^^( j!fc!(n-j-fc)! )- 
Note that M is maximized when j = k = n — j — k = |. So, 

M = 



~ 33/2^ — , by StirUng's formula 

ZTrn 

on 

= K- 

n 

We can now proceed with our original sum: 

Ep(^") < E^ej (njEE^7r i!fe!(n-i-fe)! 

oc / , \ 2n 



" ]^ 



^V27 V 7 « 3" 7'!A;!(n- j - A;)! 



n=l 
00 ^ 

~ — by StirUng's formula 
nJirn 

< 00 

Since X^Pl-Bn) converges, then by Lemma 2.2, P(£'„ , i.o.) = 0, or it is not certain 
that wc will return to the origin in a three-dimensional random walk. In fact, by 
experimentation, the probability that a random walk in three dimensions returns 
to the origin is approximately 0.65 [1]. Thus we cannot ensure with certainty that 
our flying drunkard will return back to where he started. 
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